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CLAIMS 

What is claimed is: 

1 1 . Assystem for unobtrusively detecting a subject's level of interest in media 

2 content, comprising: 

3 means tbr detecting to what a subject is attending; 

4 means for measuring a subject's relative arousal level; and 

5 means for combimhg information regarding said subject's arousal 

6 level and attention to infer a levbl of interest. 

1 2. Thdysystem according to claim 1, wherein said detecting means includes 

2 means for ifetermining a target to which a gaze of the subject is directed. 

1 3. The system according to claim 2, wherein said determining means further 

2 includes means for determining a duration of fixation time of said gaze. 

1 4. The system according to claim 3, wherein said measuring means includes 

2 means for determining whether the subject is attending to the media content. 

1 5. The system according to claim\ wherein said measuring means further 

2 includes means for measuring the subject's facial gestures. 
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6. The sy ^tem according to claim 5, wherein said measuring means further 
includes means for measuring the subject's head gestures. 



7. The systqm according to claim 6, wherein said measuring means further 
includes means for measuring the subject's speech. 

8. The system, according to claim 1, wherein said measuring means includes 
means for measuring the subject's facial gestures. 

9. The system according to claim 1, wherein said measuring means includes 
means for measuring the subject's head gestures. 

10. The system according to claim 1, wherein said measuring means 
includes means for measuring the subject's speech. 

1 1 . The system according to claim 1 , wherein said level of interest 
produced provides relevance feedback associated with said subject to a 
manager of said media content. 



12. A system for unobtrusively detecting an object of a subject's interest 
in media content, comprising: 

means for detectingythe object to which the subject is attending; 
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means for measuring the subject's relative arousal level; and 
means for combining information regarding said subject's arousal 
level and attention to ih{er the object of interest. 



IB. The system according to claim 12, wherein said detecting means 

2 includes means for determining a target to which a gaze of the subject is 

3 directed. 

1 14. Thd system according to claim 13, wherein said determining means 

2 further includes means for determining a duration of fixation time of said 

3 gaze. \ 

1 15. The system according to claim 14, wherein said measuring means 

2 includes means rar determining whether the subject is attending to the media 

3 content. \ 

1 16. The system according to claim 15, wherein said measuring means 

2 further includes means for measuring the subject's facial gestures. 

1 17. The system according tb claim 16, wherein said measuring means 

2 further includes means for measuring the subject's head gestures. 

1 18. The system according to claim 17, wherein said measuring means 
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further includes means for measuring the subject's speech. 

19. The system according to claim 12, wherein said measuring means 
includes means for measuring the subject's facial gestures. 



20. The System according to claim 12, wherein said measuring means 
includes means for measuring the subject's head gestures. 

21. The system according to claim 12, wherein said measuring means 
includes means for measuring the subject's speech. 

22. The system according to claim 12, wherein said level of interest 
produced provides\relevance feedback associated with said subject to a 
manager of said media content. 



23\A method of unobtrusively detecting a subject's level of interest in 

media content, comprising: 

detectihg to what a subject is attending; 

measuring Subject's relative arousal level; and 

combining information regarding said subject's arousal level and 

attention to infer a level of mterest. 



24. The metKfcKl according to claim 23, wherein said detecting includes 
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determiiing a target to which a gaze of the subject is directed. 

25. The method according to claim 24, wherein said determining further 
includes determining a duration of fixation time of said gaze. 

26. The method according to claim 25, wherein said measuring includes 
determining Whether the subject is attending to the target information. 

27. The method according to claim 26, wherein said measuring further 
includes measuriiW the subject's facial gestures. 

28. The method according to claim 27, wherein said measuring further 
includes measuring the subject's head gestures. 

29. The method accorqing to claim 28, wherein said measuring further 
includes measuring the subject's speech. 

30. The method according to claim 23, wherein said measuring includes 
measuring the subject's facial gestures. 



31 . The method according td claim 23, wherein said measuring includes 
measuring the subject's head gestures. 
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32. The method according to claim 23, wherein said measuring includes 
measuring Vhe subject's speech. 

33. The methad according to claim 23, wherein said level of interest 
produced provides relevance feedback associated with said subject to a 
manager of said media content. 

3*k A method of unobtrusively detecting the object of a subject's interest 

in medili content, comprising: 

detecting the object the subject is attending; 

measuring the subject's relative arousal level; and 

combining information regarding the subject's arousal level and 

attention to infer the object of interest. 

35. T^e method according to claim 34, wherein said detecting includes 
determining a target to which a gaze of the subject is directed. 

36. The methodVxording to claim 35, wherein said determining further 
includes determining a duration of fixation time of said gaze. 

37. The method according to claim 36, wherein said measuring includes 
determining whether the subject is attending to the target information. 
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1 38. The method according to claim 37, wherein said measuring further 

2 includesyneasuring the subject's facial gestures. 

1 39. The method according to claim 38, wherein said measuring further 

2 includes measuring the subject's head gestures. 

1 40. The methodtaccording to claim 39, wherein said measuring further 

2 includes measuring the subject's speech. 

1 41 . The method according to claim 34, wherein said measuring includes 

2 measuring the subject's facial gestures. 

1 42. The method according to claim 34, wherein said measuring includes 

2 measuring the subject's head gestures. 

1 43. The method according tto claim 34, wherein said measuring includes 

2 measuring the subject's speech. 

1 44. The method according to claim 34, wherein said level of interest 

2 produced provides relevance feedback associated with said subject. 

1 45. A method for detecting a person's level of interest in media content, 

2 comprising: \ 
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assessing whether a person is attending to the media content, to 
produce firsfsdata; 

assessing^ person's relative arousal level with regard to the media 
content, to produce\second data; 

combining saicKfirst and second data to infer a level of interest the 
person has in said media content; and 

communicating said level of interest as feedback about the media 
content to a manager of said medja content. 

. Thk method according to claim 45, wherein said assessing includes 
determining a target to which a gaze of the person is directed. 

47. The method according to claim 46, wherein said assessing further 
includes determining^ duration of fixation time of said gaze. 

48. The method according reclaim 45, wherein said assessing includes 
determining whether the person^ attending to the media content. 

49. The method according to claim 43L wherein said assessing includes 
measuring a person's facial gestures. \ 

50. The method according to claim 45, wherein said assessing includes 
measuring the person's head gestures. \ 
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1 51. The method according to claim 45, wherein said assessing includes 

2 measuring\the subject's speech. 

1 52. The methoci according to claim 45, wherein said level of interest 

2 produced providesVelevance feedback associated with said subject. 

1 53\ A signal-bearing medium tangibly embodying a program of machine- 

2 readable instructions executable by a digital processing apparatus to perform 

3 a methodVor computer-implemented unobtrusive detection of a subject's 

4 level of interest in media content, said method comprising: 

5 detectingao what a subject is attending; 

6 measuring k subject's relative arousal level; and 

7 combining information regarding said subject's arousal level and 

8 attention to infer a levelW interest. 

1 54. A signal-bearing mediunMangibly embodying a program of machine- 

2 readable instructions executable by a digital processing apparatus to perform 

3 a method for computer-implemented unobtrusive detection of a subject's 

4 level of interest in media content, said method comprising: 

5 assessing whether a subject is attending to the media content, to 

6 produce first data; \ 

7 assessing a subject's relative arousal\evel with regard to the media 
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content, to^produce second data; 

combining said first and second data to infer a level of interest the 
subject has in said media content; and 

communicating s^d level of interest as feedback about the media 
content to a manager of saidNpedia content. 
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